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Abstract 

When the ordinary differential equation (ODE in short) 

f («) = &(*(*)). 

\ £(0) =x G R", 

where b : R n — > R n , has not a Lipschitz right hand side, there is neither existence 
nor uniqueness property of the associated Cauchy problem. However, the perturbed 
stochastic differential equation (SDE in short) 

f dX £ (t) = b (X £ (t)) dt + edW t , 
\ X £ (0) = x G R n , 

where W is a re-dimensional standard Brownian motion, has a unique strong solution 
when b is only continuous and bounded. Moreover, when e — > 0, the solutions to the 
perturbed SDE converges, in a sense, to the solutions of ODE. This phenomenon has 
been extensively studied in the literature in the one dimensional case. The goal of 
present paper is to analyzes the multi-dimensional case (this needs slightly different 
technique that in dimension one). In the case where the ODE has infinity many so- 
lutions, one of the main outcome of our approach is to explain which solutions of the 
ODE can be the limits of the solutions of the perturbed SDE. 
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1 Introduction 

Recall that the following ordinary differential equation (ODE in short) 

d£(t) = b(t(t))dt, ( u 

£(0) = x, f >0, 1 ' ] 

may have many solutions or may have no solution at all if b : R ra — > R ra is not Lipschitz 
continuous. However, one can regularize this equation by adding the white noise edW t to 
its right-hand side with any positive small intensity e > and n-dimensional Brownian 
motion W which is the n-dimensional coordinate process on the classical Wiener space 
(fl, J 7 , P), i.e.,Q is the set of continuous functions from [0, +oo) to R n starting from (fl — 
C([0, +oo) ; R n )), J 7 the completed Borel cr-algebra over Q, P the Wiener measure and W 
the canonical process: W s (ou) = u s , s G [0, +oo) , w 6 fi. By {J 7 ,,, < s < +00} we denote 
the natural filtration generated by {W s } 0<s<+oo and augmented by all P-null sets. 

In other words, for any bounded Borel function b : R n — > R n , x G R n and n-dimensional 
Brownian motion W, there exists a unique strong solution of the following stochastic differ- 
ential equation (SDE in short) 

dX^(t) = b (X^ (t)) dt + edW t , (1 2) 



X £ (0) = x, 

for any e > 0. This result can be seen in [13], [15]. 

A natural question concerns the behavior of the limit of perturbed SDE (1.2) with respect 
to the ODE (1.1), as e — > 0. In the classical Lipschitz case we refer to Friedlin and Wentzell 
[7]. In the case of where b is only continuous, more complex situation may occur. To show 
this phenomenon, we will explain precisely an easy one-dimensional example (taken from 
[4]) as follows: 

Example 1. Putb(x) = 2sign(x)^/\x~\,. The ODE 



U(o) = o. (L3) 

has infinity many solutions that among them only both extremal solutions "t — > t 2 and t — > 
—t 2 " are limiting of the corresponding SDE. More precisely, the limit of (1.2) are continuous 
stochastic processes denoted by X (•) which satisfies 

P {X (t) =t 2 ^- 1 



P(X (t) = -t 2 ) - 1 



2 • 
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In the literature, the general one-dimensional case was for instance considered by Banco, 
et al. [3, 4]. They showed that the limit of perturbed SDE (1.2) are processes which support 
belong to the solution of ODE (1.1). In Gradinaru et al. [11], using the large deviation 
technique a more precise description of the limit provided in the case 

£(t)=28ign(Z(t))\Z(t)\\ 76(0,1). 

For the multi-dimensional case the outcome of Buckdahn et al. [6] shows that the limit 
has support in the set of solutions of ODE (1.1). Our main aim is to provide a more precise 
description to the limit (consider the Example 1, the constant solution £ (t) = is a solution 
of ODE (1.3) but is not in the support of the limit processes). For other discussion, see [9]. 

To our best knowledge, the existing technique of one-dimensional case is based on the 
explicit computation of the laws of X £ (•). Indeed, in [3], [4], the laws are allowed by studying 
the Boundary Value Problems. In [10], laws are derived from the large deviation theory as 
analytic tools. However, in the multi-dimensional case, many computations of laws is hardly 
possible. 

Our approach to the problem (1.1), (1.2) is different from the above mentioned ones, and 
it is based on the use of exit time and related first and second order Hamilton- Jacobi-Bellman 
equation (H-J-B equation). We shall show that the exit time of SDE (1.2) as the solution of 
the second order H-J-B equation converges to exit time of optimal solution (defined in next 
section) for ODE (1.1), as e — > 0. Then, we are able to show (under certain conditions on b) 
that the optimal solutions of ODE (1.1) are cluster point, with some positive probability. 

This paper is organized as follows: In the next section we present some preliminaries. 
Section 3 is concern with the properties of exit time for deterministic systems, especially, 
the continuity of exit time function. Section 4 is devoted to study the first and second order 
H-J-B equation arising from the exit time problems. After having characterized the value 
functions Vfc (U £ ) defined below, as a unique continuous viscosity solutions (unique Sobolev 
and also continuous solution) of associated first (second) order H-J-B equation, we give the 
main result in Section 5 with some examples. 

2 Preliminary 

Next we define the exit time of a continuous function x (•) G C ([0, T] ; R n ) . Some notations 
will be given in following sections if necessary. 

Definition 2. Let JC C R n be a closed subset and x (•) G C ([0, +oo) ; R n ) be a continuous 
function. We denote by 

r K : C ([0, +oo) ; R n ) ->• R+ U {+00} 
the exit functional associating with x (•) its exit time t k (x (•)) defined by 

T K (x(-))=M{te [0,+oo)\x(t)$K}. 
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We observe that 

Vte [0, TK (x (•))), x(t)elC, 

and that, when Tfc (# (•)) is finite, 

x(r jC (x(-)))e9/C. 

We use the convention inf {0} = +00, so that x {tk (x (•))) is infinite means that x(t) E JC 
for all t > 0. 

We will need the following lemma (see in [1] Lemma 4.2.2. page 134). 

Lemma 3. Let JC C R n be a closed subset. The functional Tfc is an upper semicontinuous 
when C ([0, +00) ; R n ) is supplied with the pointwise convergence topology. 

Consider the following assumption 

(HI): b(-) : R n — > R n , is bounded and continuous. 

Recall that, under the assumption (HI), SDE (1.2) has a unique strong solution (for more 
information see [15]). 

3 Ordinary Differential Equation 

In general, under the assumptions (HI), the uniqueness of solution for (1.1) may fail. Hence, 
we denote S x (b) the trajectories of solutions of (1.1) starting from x if (1.1) admits many 
solutions. Denote /C —Int{K) a compact subset of R n such that Glnt(/C). Typically, 
K =£(0,1) • 

Set x = and note that if b (0) 7^ 0, the trajectories of solutions will leave the center 
point, but if 6(0) = 0, the equation (1.1) may have zero solution which means that the 
trajectory will never touch the boundary of the closed ball /C. Replacing b by b (x) — b (0) if 
necessary, we then attain a new ODE with £ (t) = is a solution. For simplicity, we assume 
the following assumption. 

(H2): 6(0) = and <£lnt{x\b(x) = 0} . 

Indeed, clearly if elnt{x| b(x) = 0} the constant solution is the only solution to (1.1) 
with £ (t) = 0. Actually, (H2) means that not only the zero is one of the solutions of (1.1), 
but also there exist many other non-zero solutions. 

From now on, we are concerned with the solutions of (1.1) which reach the boundary of 
/C as fast as possible. Let us denote the exit time function as follows: 

Vjc (x) = inj : foe (? (•))] , x G /C, (3.3) 

where /C is a closed and bounded subset of R n . 
We give the following. 
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Lemma 4. Assume (HI) and (H2) hold. If Vic (0) < +oo 7 for some suitable JC, then there 
exist optimal solutions £° (•) G <So (b) of (1.1), such that 

f° (V K (0)) G dJC and e° ((0, V K (0))) G Int(JC) . (3.4) 

The proof is not difficult, we omit it. 

Remark 5. In [3], the author also gave the similar assumption, that is, for some r > the 
exit time Vic is finite. Actually, for one- dimensional case, the expression of exit time can be 
obtained easily. But for general case, it is impossible to give the explicit expression. 

Remark 6. It is necessary to point out that the trajectories of the optimal solution may not 
be unique (see Example 1). 

On the other hand, in order to prove that Vic is a lower semicontinous function, we give 
the following assumption. The idea is borrowed from [12]. 

(H3): Assume that 

(b(x),n(x)} >0, VxedtC, 

where n(x) denotes the unit outward normal. Furthermore, we assume dJC is C 1 , so 
that n (x) is continuous and well-defined. 

Clearly, (H3) means that as soon as of every trajectory of (1.1) reaches the boundary of 
JC, then it leaves the ball immediately. However, as we have shown in Lemma 5, there may 
be infinite many optimal solutions starting from which means that it is a singular point. 
Hence, we have the following. 

Lemma 7. Under the assumptions (HI), (H2) and (H3), for some compact domain JC, the 
function Vk, '■ JC/ {0} — >: R + [J {+00} is a continuous function. 

Proof. Firstly, the function Vic being on infimum of a family of upper semicontinuous function 
(in view of formula (3.3) and Lemma 3), consequently, it is upper semicontinuous. It is remain 
to show that V/c is a lower semicontinuous function. Fix x G JC/ {0} . We wish to prove that 
Vic is lower semicontinuous, namely, 

liminfV K (?/)>V /c (a;). (3.6) 

This is clearly valid if Vic (x) = on lim inf y ^ x Vic (y) < +00. Assume that Vic (x) > and 
liminfj^Vx; (y) < +00. 

Suppose, on the contrary, that (3.6) does not hold true. Hence there exists e > 0, and 
x n G JC with \x n — x\ < i and 

t := lim V K (x n ) < V K (x) - e. 

n— >oo 
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By lemma 5, there exist (t) G S Xn (b) such that Vk (x n ) = r K [Q n (•)) and 

e([0,V K (x n )])c/C. (3.7) 

Because b is bounded, then it is easy to check that (£^ n (•)) are equicontinuous. Hence, 
using Arzela-Ascoli Theorem, we know that there exist (■) — > £ x (•) uniformly on the 
[0,T] (up to a subsequence). 

But (H3) implies that £ x (•) leaves /C instantly after t, and from (3.7) we have £ x ([0, f|) C 
/C. Thus we obtain Tfc (•)) = i, which is contradiction to t < V/c (x) — e. The proof is 
complete. □ 

Now let us recall the following result adapted to Theorem 4 in [6] . 

Proposition 8. Suppose that (HI) holds. Let X x ' £ be a strong solution to the SDE [1.2]. 

Then, there exists e n — > such that X x ' £n (•) converges in law, as e n — > 0, to some X° (■) 
which belongs almost surely to the set of solution to (1.1). 

The proof being similar to Theorem 4 in [6] we omit it. Hence, a natural question is that 
what the solutions belonging to set of solutions of (1.1) are the limit solutions of (1.2) with 
some positive probability. 



4 First and Second order H-J-B equation 

In this subsection, we are devoted to investigate the first and second order H-J-B equation 
respectively arising from the exit problem. For the first order one, because the continuity 
of Vic has been already proved in Section 3 on some special domain. Therefore, viscosity 
solution theory may be applied. While for second order one, we use the theory of elliptic 
PDEs of second order . 



4.1 First order H-J-B equation 

Consider the following first order H-J-B equation 

- (b (x) , Du (x)) -1 = 0, x eV, 
u (x) — 0, x G dV, 



(4.1.1) 



where b satisfies (HI) and V is a bounded open subset of R™. 

We want to prove that the exit time as a value function without control for deterministic 
system is the unique viscosity solution of equation (4.1.1). Let us first recall the definition 
of a viscosity solution of equation (4.1.1). 

Definition 9. A real-valued continuous function u G C(R ra ;R) is called 

(i) a viscosity subsolution of equation (4-1.1) if u (x) < 0, for all x G dV, and if for all 
functions (p G C 1 (R n ; R) and x G V such that u — ip attains its local maximum at x 

- (b(x),Dip (x)) - 1 < 0. 
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(ii) a viscosity supersolution of equation (4-1.1) if u (x) > 0, for all x G dV, and if for 
all functions ip G C 1 (R n ; R) and x G V such that u — ip attains its local minimum at x 

- (b(x),Dip (x)) - 1 > 0. 

(Hi) a viscosity solution of equation (4-1.1) if it is both a viscosity sub- and a supersolution 
of equation (4-1-1)- 

We show first that the value function Vic (x) is a continuous viscosity solution of equation 
(4.1.1). The proof is classical but it is written for sake of completeness. 

Proposition 10. Under the assumptions in Lemma 6, we claim that V/c is a continuous 
viscosity solution of the following first order H-J-B equation 

u (x) — 0, x G dK,. 

Proof. Obviously, Vfc (x) = 0, x G dJC. Let us show in a first step that Vfc is a viscosity 
super- solution. For this we suppose that, for all ip G C 1 (R n ; R) , whenever x G K, is a point 
of local minimum of — ip, that is 

v (y) < Vk (y) y ^ x .. 

Then combining to the definition of Vfc and the optimal solution if (■) obtained in Lemma 
5, we have 

v (x ) = v K (r (t)) +t> v (r (tj\ + 1, 



that is 

v (r° (*)) - (xo) 



<-l, 



Letting t tend to 0, we get 

(Dip (x ),b(x )) < -1. 

Hence Vtc is a viscosity super-solution. The proof to sub-solution being similar we omit it. 
The proof is complete. □ 

Now set 

H{x,p) = -(b(x),p)-l, Vi6R n , VpeR". (4.1.3) 
We recall the following a comparison principle for (4.1.1) from 
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Proposition 11. (Theorem 5.9, Page 82, in [5]) Let V be a bounded open subset o/R n . 
Assume u±, Ui G C (X>) are, respectively viscosity sub- and super-solution of (4-1-1) in D 
with U\ < u 2 on dT>. Assume that H satisfies 

\H (x,p) -H(y,p)\< Wl (\x -y\{l + \p\)) (4.1.4) 

where W\ is the modulus^ of H , for x, y,E T> and p G R n . Also, 

p — > H (x,p) is convex on R n for each x G V; (4.1.5) 

there exists 

<p G C (V) n C 1 (V) (4.1.6) 

such that if < u\ inT> and 

sup H (x,Dip(x)) < 0, yfYcV. (4.1.7) 

xev' 

Then 

U\ < U2, in T>. 

As a straightforward consequence we attain the following. 

Lemma 12. Under the assumptions Proposition 9, we claim that V/c is a unique continuous 
viscosity solution to the H-J-B equation (4-1-2). 

Proof. Clearly, it is easy to check that H (x,p) = — (b (x) ,p) — 1 satisfies (4.1.4) and (4.1.5). 
Indeed, we have 

\H(x,p)-H(y,p)\ = \(b(x) -b(y) ,p}\ 

< w b (\x-y\)\p\ 

< w b (\x-y\)(l + \p\). 

The second inequality holds by Schwartz's inequality. To verify (4.1.7), setting ip (x) = 
min V/c (y) , % G /C, by Proposition 10, we get the desired result. □ 

yeK. 

1 We say that b is a uniformly continuous function, that is, there exists a Wb (r) modulus of continuity 
(i.e. Wb ■ [0, +oo) — > [0, +oo) continuous, nondecreasing with w (0) = 0) such that 

\b(x) — b{y)\ < Wb (\x — y\) , Vrr, y G domain of b. 



8 



4.2 Second order H-J-B Equation 

Consider the SDE (1.1) and define 

6 £ (x) = inf {t > : X x ' £ (t) <£ £} , Vx G IC,e > 0, 

and 

U £ (x) = E [6 £ (x)} , xeJC,e>0. 

We introduce some notations. For any q > 1, denote by W 2,q (JC) the Sobolev space 
equipped with the following norm: 

IMIw 2 .«(k:) := + II^^IIl^/c) + 1 1 1 1 £«(*:) ' 

where 

i 

I./ H ){' ' 

K 

From now on, we assume that /C is a compact manifold of class (C 1 ' 1 )!. Let us recall 
the following lemmas. 

Lemma 13. (Theorem 9.15 and Corollary 9.18, Page 243, in [10]) Assume that (HI) holds. 
Then, for fixed e > 0, the following elliptic-type PDE 

C £ u £ (x) = 1, xeJC, (A?-\\ 
u £ (x) = 0, x G dKL, K > 

where 

- ft P 2 - ft 2 



dxi 2 ^ dxidxn ' 



"i f . . yj^Ji^JJ^'i 

1=1 i,J 



2 Assume that K be a compact C 1 manifold in R" , hence there exists a C 1 function -0 : R" — > R, such 
that 

K = {xeK n : iJj (x) < 0} . 

and 

for Vz G R", (x) = V0 (x) 7^ 0. 

Consequently, we have 

f L{ieR":^(i)<0}^, 
1 92f = {ie R™ : ^ (ar) = 0} ^ $. 



For instance when 
the associated set A is the closed ball 



ip (x) = \x\ 2 — r, for some r > 0, 



= e R™ : -0 (a) < 0} . 



3 Here C 1 ' denotes the Holder space consisting of functions whose 1-st order partial derivatives are 
uniformly Holder continuous with exponent a = 1. 
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has a unique solution u £ G (Wq' p (/C))0D W 2 * (K) fl C (JC) , /or some p > |. 

We have the following Krylov's estimate. 

Lemma 14. Assume that (HI) holds. Then for any B or el function f (x) G 
q > n + 2, we have 

E / f(X x ' £ (t))dt <N 

'o 



Li{K) 



and 



L«(K) 



(4.2.2) 



where N is a constant depending only on /C, e, T and 6.. 

We omit the proof of Lemma 13 since it is very similar to that of Theorem 3 in [14]. The 
following result generalizes Krylov's extension of Ito's formula. 

Lemma 15. Assume that (HI) holds. Then for any u : R n — > R from the Sobolev space 
W 2 ' p (JC) , p > n + 2 we have 

u (X x ' e {t)) - u e {x) = [ {C e u(X x ' £ {s)))ds + e [ d x u {X x ' £ (s)) dW s , (4.2.3) 

Jo Jo 

almost surely for t <9 e (x) A T, where T > 0. 

Proof. The proof is classical. For the convenience of the reader we give the details of the 
proof. At the beginning, we show that each integral in (4.2.3) is well-defined. Noting that 
/C is compact manifold of class C 1,1 , by virtue of Sobolev's embedding theorem there exists 
a constant N such that 



sup \u(x) \ + \d x 

x&K V ~^ 



u(x)\ J < N \\u\\ w2tP{)C) . 



for all u G W 2 ' p (1C) , p > n + 2. Hence 

r-e e (x)/\T 



\d x u (X^ (s))\ z ds 



< e T \\u 



W 2 -p{K) ' 



and 



E 



6 £ (x)AT 



\b(X x ^ (s))d Xi u(x)\ds 



< MT \\u\ 



W 2 'P(K) ' 



(4.2.4) 



(4.2.5) 



by the boundness of 6. Moreover, 

l £ (i)AT 

'0 



e 2 E 



<),- .,, a (X 1 - (s))\ds 



< e 2 N H^^wll^) < e 2 NT \\u\\ w2>p{JC) , 



(4.2.6) 



4 Wq' p (JC) arises by taking the closure of Cq (JC) in W l p (JC) where Cq (JC) denotes the set of functions 
in C 1 (JC) with compact support in JC. 
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by Lemma 13. Consequently, the right-hand side of (4.2.3) is well-defined for t < T A0 £ (x) 
Actually, for u G W 2 ' p (/C) there exists a sequence of function u n in C 2 (R n ) such that 

\\ u n — u \\w 2 'P(K) ~ * 0' as n — )• +oo. 
Applying Ito's formula we have 



u n {X x ' £ (tA0 £ (x)AT))-u n (x) 

r tA9 e (x)/\T 



pt/\a- (x)/\i rtA9 £ (x)AT 

= / (jC e u n (X^(s)))ds + e / 9 x « n (X ie ' e (s))dW a . 

Jo Jo 

(4.2.7) 

for any t > 0. On the other hand, the inequalities (4.2.4), (4.2.5), (4.2.6) hold with u — u n 
replacing of u, with constants independent of n. Lastly, letting n — > +oo in (4.2.7) we get 



the desired result. 



□ 



We are now in a position to make a important observations as follows: 

Lemma 16. Letu £ G W 1 ' p (/C) fW 2 ' p (/C) HC (/C) , p > n + 2, 6e a unique solution of (4.2.1). 
Under the assumption (HI), we have 

u £ (x) = U £ (x), x G /C. 

Proof. Applying Lemma 14 to u £ and taking the expectation, we have 



E [u £ (X x > £ (9 £ (x))) - u £ {x)\ 
e e {x) 



= E 



/ (C £ u £ (X x ' £ (s)) + l)ds- lds + e d x u £ (X x ' £ (s)) 

Jo Jo Jo 



Since 



C e u e ( X x,s ( s )j + 1] = 0, 

ef° e(x) d x u £ (X x > £ (s))dW s ] =0, 



we obtain 



u £ (x) = E [9 £ (x)} = U £ (x), x G /C. 

The proof is complete. 

Remark 17. Because the diffusion term is not degenerated, the 9 £ is almost surely finite. 



□ 
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5 Main Results 

In Section 4, we have studied the first and second order H-J-B equation, respectively. How- 
ever, a question is that what is the relationship between Vic and U e as e — > 0. To answer it, 
we first give the following Lemma 16. Then, we shall be devoted to show our main result. 

Lemma 18. Assume that b satisfies the assumptions (HI) and (H2) hold. Let JC be a suitable 
compact manifold of class C 1 , such that (H3) holds. Then for almost everywhere \mi9 e (x) 

E— >0 

exists, x £ JC. Furthermore we have, 

limr (x) = 9(x), P-a.s. (5.1) 

where 9 is the exit time of limiting solution of SDE (1.2). 

Proof. Considering the perturbed SDE (1.2), one can easily show that the family of laws 

{po(r.°)- 1 ,e>o} 

is tight. Hence, by virtue of Prokhorov's theorem, there exists a sequence e n — > + with 
j P (x £ - ) -1 } -^{Po (X £ '°) -1 } , as n ->• +oo. 

Then using the Skohorod's theorem we can find a new probability space (^1, T , pj and 
stochastic processes X £n ,X defined on (tl, J 7 , pj , such that 

f (1) P o (X £ - (•)) 1 = P o (X e " (•))~ 1 and P o (X (•)) 1 = P o (X (-))" 1 

[ (2) in the topology of the uniformly convergence on compact, X £n (•) — > X (•) , a.s. 

(5.4) 

Hence, for arbitrarily given T > 0, 

X £ "{-) in C([0,T];R n ), P-a.s. (5.5) 

We now prove the lemma by contradiction. Set 



i:= wGfl 



lim sup 9 s (x, oo) > 9 (x, u) > . 



£-5>0 



Suppose that P (A) > 0. Now consider the following limiting SDE association with stochastic 
system (1.2) as e — > 0, 



t 



X(t)-X(0) = j b (x (s)) ds, X (0) E dlC, Vt > 0. 



o 

12 



Define a closed set JC\ := {x\ ip (x) < A, < A < 1} , where ip is a C 1 function corresponding 
to JC. Obviously, JC C JC\. By assumption (H4), we define 

2aC x := inf (b(x) ,Vip {x)) > 0, 

where C\ is the local Lipschitz constant of tp on JC\. Taking rj G (0, A) small enough, such 
that 

\/y G {x : —r] < ip (x) < i]} , 

we have 

(b(y),V4>(y))>C x a 
since the continuity of b. In particular, picking t > such that Wt G [0,t] , we have 



T) < 1p [X (t) ) < T). 



Note that 

Id 

2dt 

Thus 



i> [x (t)) = ( W (X (t)) , X' (t)) = ( W> (X (t)) , 6 [x (*)) ) > «C A . 



V> (x(£)) > 2aC A t, t G [0,t] . 
On the other hand, combining (5.4) and (5.5), we have 



X £n (9 (x,u) + i)-X(i) 



< at, for n large enough. 



Note that 



X{t)=X{9 (x, uo)+t) and V G C 1 . 
Consequently, for any oj G A, we have 

i) {X s - {9 (x, u>) +t)) > i) (x (£)) - C A |x (t) - X s " {9 (x, ou)+t) 

> 2aiC x - aiC x > 

which implies that 

9 £n (x, lu)<9 (x, uj) + t. 
Passing to limsup as n — > +oo, we obtain 

limsup 9 £n (x, uj) < 9 (x, uj) , 

n— >+oo 



which is contradiction with the definition of uj G A. 
Now we define 

B = |w G Q 



lim inf e (x, w) < 9 (x, u) > . 

e^O J 
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Fixing uj G B, for any 5 G [0, 9 (x, u)) , It is easy prove by absurdum that there exists 
n > n (S) , such that 

(e(x, u)-5^j-x (e(x, u)-5^j + ^(x (e(x, u) - <s)) < o, 

from which we conclude that 



Since arbitrary of <5, we have 



9 £n (x, cu)>9 (x, to) - 5. 



lim inf 9 £n (x, to) > 9 (x, to) , 

n— t+oc 



which is contradiction with the definition of oo G B. 
Now we end the proof by observing that 



1 = P 

Because of (5.4), we can conclude that 
1 = P 



lim0 e (x) = 9{x) 



\im9 £ (x) = 9(x) 



= P 



\im9 £ (x) = 9{x) 

e^O 



□ 



The proof is complete. 

Now Let us introduce the following definitions of viscosity solution for second-order PDE: 

F [x, V, DV, D 2 V) = 0, xeVl, (5.5) 
where Q C R ra denotes an open set. 

Definition 19. (i) We say that V G C (Q) is a viscosity subsolution of (5.5) at a point 
x G Q, if and only if, for any test function if G C 2 (Q) such that V — ip has a local maximum 
at x Q , then 

F (x , V (x ) , D V (x ) , D 2 ip (x )) < 0; (5.6) 

(ii) We say that V G C (Q) is a viscosity supersolution of (5.5) at a point x G Q, if and 
only if, for any test function ip G C 2 (Q) such that V — ip has a local minimum at x , then 



F (x , V (x ) , Dip (x ) , D 2 ip (x )) > 0; 



(5.7) 



(Hi) We say that V is a viscosity solution in the open set QifVisa viscosity subsolution 
and a viscosity supersolution, at any point xo G f2. 

We will characterize the mean of exit time as unique viscosity solution of the H-J-B 
equation (4.2.1). 

Lemma 20. Let e > be fixed. Then, U e is a unique nonnegative viscosity solution of H-J-B 
equation (4-2.1). 
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< -1, 



Proof. The uniqueness is obtained from Lemma 12. We shall prove U £ is the viscosity 
solution of (4.1.2). Obviously, W (x) = 0, x E dIC. Let us show in a first step that W is a 
viscosity super-solution. For this we suppose that, for all compactly-supported C 2 (R ra ; R) 
(twice differentiable with continuous second derivatives) function (p : R ra — > R, whenever x 
is a point of local minimum of U £ — tp, that is 

if (x ) = U £ (x ) , 

<p (y) <u £ (y)> y± x . 

Then, thanks to the pathwise uniqueness of SDEs (1.2), we have 

Ejy (X £ (t))]-y( x ) 

By virtue of Dynkin's formula, we have 

n d e 2 n d 2 

Y, b M ^ M + Y E (-») + 1 £ o. 

i=l * i,j=l * J 

Similarly, the sub-solution is proved. The proof is complete. □ 

Next we will give a stability property of viscosity solutions of (5.5). This property states 
that if the viscosity solutions V £ of approximate equations depending on a small parameter 
e are uniformly convergent as e — > 0, then the limiting function V is a viscosity solution of 
the limit equation. 

Proposition 21. (Stability result, Lemma 6.2, in [8]) Let V s be a viscosity subsolution (or 
super- solution) of 

F £ (x, V £ (x) , D X V £ (x) , D 2 X V £ (x)) = (5.8) 

in domain, with some continuous function F £ satisfying the ellipticity condition. Suppose that 
F £ converges to F, uniformly on every compact subset of its domain, and V s converges to V , 
uniformly on compact subset Q o/R n . Then V is a viscosity subsolution (or a super solution, 
respectively) of the limiting equation 

F (x, V (x) , D X V (x) , D 2 V (x)) = 0. (5.9) 

The following theorem will tell us that, for multi-dimensional autonomous cases, under 
some certain assumptions, we claim that, the limiting solutions "prefer" the optimal solutions 
of ODE which leave the initial point as fast as possible, that is, the limits solution of 
perturbed SDE are optimal ones for the exit time of ODE. 

Theorem 22. Assume (HI) and (H2) hold. Given a compact manifold of class C 1 ' 1 , JC such 
that Vic is continuous at and (H3) holds, then we have 



E 



T K (X°(-))] =Vk(0) = r K (?(■)), (5.10) 
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where X° (•) is the limiting solution of the following SDE: 

dX^ £ (t) = b (X°' e (*)) dt + e<R¥ t 
X°' £ (0) = 0, t > 0. 

Proof. In Section 4, we have shown that Vic is the unique continuous viscosity solution of 
H-J-B equation: 

" - (b(x) ,Du(x)) - 1 = 0, xG/C, 
u (x) = 0, x G <9/C. 

In Section 3, £Y £ is a unique viscosity solution corresponding to the following H-J-B equation: 



(5.11) 



EK^<W-iE^ £ W-i = o, xg/c, 
i=i *,i=i 



(5.12) 



i,j=l 

u £ (x) = 0, x G 9/C. 

By Proposition 19, Lemma 11, and Lemma 16, we have U° is a unique viscosity solution of 
(5.11). Hence, we get 

E [6 (x)] = U° (x) = V K (x) , Vx G /C. 
On one hand, clearly, we have 

X x ' £ (t/c (X x,e (•))) G P-a.s.. 
On the other hand, tx; (X x,£ (•)) — >■ £ (o>) , as e — > 0, that is 

X x (i)edlC, P-a.s., 
where (•) denotes the limiting of X x ' £ (•), which implies that 

tk (X x (•)) < t, P - a.s. 
Hence, for almost surely, we have, 

limmf (t* (X x ' £ (•))) > 7* (x* (•)) > V K (x) . 
By Fatou Lemma, we get 

liminf E[t,c{X x ' £ {■))] > E liminf [r K {X x ' £ (•))] 



£-S>0 



£-5>0 



r K [X 



> E 



> Vk (x) = E [9 (x)] . 



:*(.))' 



Therefore, we obtain 



E 



tk[X x - 



Vk(x) 



x G JC. 



Substituting x = into (5.5), we get the desired result. 



(5.5) 



□ 
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We provide a concrete example whose trajectories of optimal solutions are non-symmetric 
in one-dimensional perturbed SDE. Simultaneously, we give the explicit optimal solutions 
and validate our major theoretical result (Theorem 20). 

Example 23. Put 

b(x) = < i (5.6) 

| — 3 \x\ 2 , x < 0. 

Then as e — > 0, there are two optimal solutions 

t 2 9t 2 

X! (*) = -, X 2 (t) = - — , t>0. 

2 

wift probability — 35 2 , respectively (for more information see [4])- Consider the closed 

1+3 3 1+33 

interval fC = [— ipi] , r > smal/ enough, while ip (x) = 1. it fairly to 

c/iecA; t/iat V*; continuous at fry Arzela-Ascoli Theorem. Moreover, Vk (0) = v^j w/ii/e 
T/c ( X° (■)) = \/rx — ^r + \/rx = Jr, where X° (•) denotes the limiting of perturbed 

\ /J 1+3^ 1+33 



holds. 



SDE with drift b defined in (5.6). Hence V K (0) = E t k (x° (•)) 

The following two examples show that the dimension of the Brownian motion with respect 
to the dimension of the state plays an important role. 

Example 24. Consider the following two-dimensional SDE: 



dX £ (t) = 2sign {X £ (*)) y /\X e (t) \dt + edW t \ 

dY £ (t) = 2sign (Y £ (t)) ^\Y £ {t)\dt + edW t 2 , (5.7) 
(X(0),F(0)) = (0,0), 

where W l ,i = 1,2 are two independent Brownian motions. From Example 1, we have 

X?(t) = (t 2 ,t 2 ) 
X$(t) = (t 2 ,-t 2 ) 
Xl(t) = (-t 2 ,t 2 ) 
xl {t) = (-t 2 , -t 2 ) 

with probability |, respectively, furthermore, the exit time is ^f- from the ball 5(0, r) for 
some small r > 0. 

Remark 25. Consider the example similar to (5.7) but with a one dimensional Brownian 
motion (W t ) t>0 , 

dX £ (t) = 2sgn(X £ (t)) ^ /\X £ (t) \dt + sdW t , 
dY £ (t) = 2sgn (Y £ (t)) y/\Y £ (t)\dt + edW t , 
(X(0),F(0)) = (0,0). 
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Clearly, X (•) and Y (•) have the same finite-dimensional distributions on the same probability 
and state space. Hence we claim that 

X° (t) = (t 2 ,t 2 ) 
Y° (t) = {-t\ -t 2 ) 

are limit solutions with probability |, respectively. 

We end this section with a two-dimensional couple case which shows infinite many optimal 
solutions. 

Example 26. Consider two-dimensional SDE, W} and W 2 are two independent Brownian 
motions, 

' dX l {t) = -dt + edW} 

dX 2 (t) = r dt + edW 2 

(X, (0),X 2 (0)) = (0,0), 



where a > b > 0. 

We study the following ODE 



dx\ (t) 
dx 2 (t) 



2x 1 (t) 



2x 2 (t) 



-rdt 



21 1 



[(*: 



21 3 



T dt 



The solutions are 



, (xi(0),a; 2 (0)) = (0,0). 

x\ (t) = at 2 cos 9 

x 2 (t) = bt 2 sin9, 9e[0,2n] 



Then, under some elliptic test domain, for example, ^ + p- = 1, it is easy to verify that all 
the rays starting from origin are optimal solutions. 



6 Conclusion 

In this article, we have shown that limit solutions of perturbed SDE are optimal solutions 
for the exit time of multi-dimensional ODE. The theory developed in this paper extends 
one-dimensional case to multi case. 
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